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We examine the Jarzynski equality for a quenching process across the critical point of second-order phase 
transitions, where absolute irreversibility and the effect of finite-sampling of the initial equilibrium distribution 
arise on an equal footing. We consider the Ising model as a prototypical example for spontaneous symmetry 
breaking and take into account the finite sampling issue by introducing a tolerance parameter. For a given 
tolerance parameter, the deviation from the Jarzynski equality depends onthe reduced coupling constant and the 
system size. In this work, we show that the deviation from the Jarzynski equality exhibits a universal scaling 
behavior inherited from the critical scaling laws of second-order phase transitions. 

PACS numbers: 05.70.Ln, 05.70.Fh, 05.20.Gg, 64.60.fd 


Introduction — Fluctuation theorems (FTs) provide uni¬ 
versal and exact relations for nonequilibrium processes irre¬ 
spective of how far a system is driven away from equilibrium. 
The discovery of FTs is a major development in nonequilib¬ 
rium statistical mechanics, pioneered by Bochkov and Ku- 
zovlev [1,2] for a special case and thriving with the celebrated 
equalities of Jarzynski [3] and Crooks [4] which hold for gen¬ 
eral forcing protocols (see, e.g., [5-8] and references therein 
for recent reviews). 

Since the discoveries of the Jarzynski equality (JE) and the 
Crooks relation, a large effort has been made to find applica¬ 
tions of these universal relations. As a representative example, 
FTs provide a unique way to evaluate the free energy differ¬ 
ence A F between equilibrium states through nonequilibrium 
processes [3], which could be useful for systems such as com¬ 
plex molecules [9, 10] that take a very long time to reach an 
equilibrium state. FTs have also been exploited to study the 
non-equilibrium dynamics [11-14], to show the emergence 
of thermodynamics out of microscopic reversibility [15], and 
to investigate the universal behaviors of the work-distribution 
tails [16] in quantum critical systems. Further, FTs by them¬ 
selves serve as useful formulae which simplify theoretical 
derivations and facilitate important developments such as in¬ 
formation thermodynamics [17]. 

Although the FTs hold universally, they require sufficient 
sampling from the states of the initial ensemble, which leads 
to a convergence problem in many situations [18-22]. For ex¬ 
ample, consider the JE, (e~ rT ) = 1, where a = /3(W — A F) 
is the irreversible entropy production, W the work performed 
to the system, and (3 the inverse temperature. The realizations 
of a thermodynamic process which yield the dominant contri¬ 
bution to the ensemble average of e~ a can be very different 
from typical realizations under the same condition. In such a 
situation, sufficient sampling of the dominant realizations be¬ 
comes intractable with increasing system size, and in reality 
the JE is hard to verify to high accuracy with a finite number 
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FIG. 1. Schematic representation of the absolute irreversibility in the 
quench dynamics of Ising model. In the forward process, the system 
is initially at equilibrium with positive spontaneous magnetization, 
whereas in the backward process the initial equilibrium state is with¬ 
out spontaneous magnetization. When the coupling strength between 
the spins is increased across the critical point (from the right to left 
in the figure), the system can have either positive or negative sponta¬ 
neous magnetization. The latter case has no corresponding forward 
path, which results in the absolute irreversibility. 


of samples in the ensemble. 

Moreover, even in the ideal case with sufficient sampling, 
there are a class of processes such as the free expansion of 
a gas, to which the JE does not apply due to a fundamen¬ 
tal reason that has been referred to as absolute irreversibility 
[23-28]. A process is called absolutely irreversible if there 
exists a path in phase space whose probability to occur in the 
forward direction is zero while that in the reverse direction is 
nonzero, or vice versa. A typical situation occurs when the ac¬ 
cessible phase spaces for the system at the beginning and end 
of a protocol are not identical. This is indeed the case for the 
free expansion of initially confined particles whose accessible 
phase space is increased by removing the partitioning barrier. 

In this Letter, we explore the fact that in systems driven 
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through second-order phase transitions, both the absolute ir¬ 
reversibility and the convergence issue can take place on an 
equal footing. Using numerical simulations and the scaling 
theory of phase transitions, the deviation from the JE is ex¬ 
amined as a function of the system size and the reduced cou¬ 
pling constant. It exhibits a universal scaling behavior inher¬ 
ited from the critical scaling of the correlation length and the 
relaxation time in second-order phase transitions. This find¬ 
ing may provide a unique application of the FTs to study the 
dynamical properties of phase transitions. 

While the detailed arguments and analyses are discussed 
below, the essential points can be summarized as follows: 
On the one hand, a natural partitioning of the phase space 
emerges as a consequence of the ergodicity breaking in the 
ordered phase [29] in contrast to the partitioning externally 
imposed in the example of free expansion. The resultant ab¬ 
solute irreversibility is illustrated in Fig. 1 for the Ising model, 
which as the simplest model showing spontaneous symmetry 
breaking will be used to anchor the rest of our discussions. 
It is expected (and proven rigorously in Section II of [30]) 
that the spontaneous breaking of Z 2 symmetry leads to a dou¬ 
bling of the accessible phase space resulting in (e~ a ) = 1/2 
when the system is quenched from the equilibrium ordered 
phase to the disordered side. On the other hand, in such a 
process the configurations with vanishing (spatial) mean or¬ 
der parameter give major contributions to (e _<T ), while such 
configurations are extremely rare in the initial equilibrium in 
the ordered phase. An observation over a finite time in real¬ 
istic experiments and numerical simulations inevitably leads 
to insufficient sampling. In this work, we account for such 
insufficient sampling by introducing a tolerance parameter to 
neglect some unlikely configurations in the initial equilibrium 
distributions. It is intriguing that the deviation from the JE 
is determined universally for a given finite value of this toler¬ 
ance. 

Model and Notations — We take the Ising model as the 
simplest example showing spontaneous symmetry breaking. 
It consists of N = L d spins {Sj = ±1| j = 1, • • ■ ,N} on 
a d-dimensional lattice of lateral size L whose interaction is 
governed by the Hamiltonian 

P (1) 

(ii> 

where (ij) denote a pairs of nearest-neighbor sites and J the 
coupling strength. We represent a spin configuration (mi¬ 
crostate) by S = (Si, S2, ■ ■ ■ , S N ), its magnetization per spin 
by S' = TV -1 Y2 j Sj, and the set of all spin configurations 
by H. The configuration space 'H consists of 'H± and Hq, 
H = H+ U H- U Ho, where 

H ± = {S\S^0}, H 0 = {S\S = 0}. (2) 

Hq is naturally empty for odd N. For even N, the contribu¬ 
tion of Hq is negligible (probability measure is zero) in the 
thermodynamic limit and hereafter we ignore it. 

We consider, for simplicity and to confirm with usual pro¬ 
tocols discussed in the context of JE, quenching processes 


where the coupling constant J(t) varies while temperature is 
kept constant. As usual, we define the reduced coupling con¬ 
stant by e(t) = 1 — J(t)/J c , where J c is the value at the 
critical point. As the time t changes from t, to tf, the re¬ 
duced coupling e changes from = e(U) to ef = e(tf) and 
the Hamiltonian from Hi = H(U) to Hf = H(tf). In or¬ 
der to discuss absolute irreversibility, we will be mostly inter¬ 
ested in quenching from the ordered (e, < 0) to disordered 
(e f > 0) phase. To avoid unnecessary complications, unless 
specified otherwise, we will consider symmetric quenching: 
e f = -e,; = e 0 > 0. 

Although the quenching process drives the system out of 
equilibrium, many physical effects and quantities are still de¬ 
scribed in terms of the initial and final equilibrium distribution 
functions 

p i/f (S) = Z7 / )e-^^, (3) 

where Z^if are the respective partition functions. Since we 
start from the ordered phase at initial time, the allowed spin 
configurations are restricted either to H+ or H- due to spon¬ 
taneous symmetry breaking. For keeping the discussion spe¬ 
cific we take the spin configurations to be in H+ giving the 
initial partition function Z, = BHi while the final 

partition function is given by Zf = J/sew e~^ Hf as usual. 
We will see that the restriction of the initial spin configura¬ 
tions has vital consequences. 

It turns out that the equilibrium probabilities Pi/f(S) of 
magnetization per spin S are particularly useful, and related 
to Pi//(S) by 

Pi/f(S) = E S ( NS - (4) 

s 

Tolerance parameter — In the so-called “sudden” (in¬ 
finitely fast) quenching (more general cases are discussed in 
[30]), the system does not have enough time to change its dis¬ 
tribution over spin configurations, and hence the initial equi¬ 
librium distribution is preserved throughout the whole pro¬ 
cess. The work distribution is thus completely determined by 
pi, leading to 

(e~P w ) = (e-^f~^) pz , ( 5 ) 

where the average (• • ■) is over the initial distribution Pi(S). 
Recall that the initial spin configurations are restricted to H+ 
due to spontaneous symmetry breaking. The exponential av¬ 
erage of the entropy production 0 = ji(W — A F) follows 
easily from (e~P w ) by multiplying by the exponential of the 
free energy change given by (3AF = —log (Zf/Zi). In re¬ 
alistic experiments and numerical simulations, spin configu¬ 
rations with exponentially small probability do not take ac¬ 
tual effects. Therefore it is natural to ignore such spin con¬ 
figurations up to certain tolerance 5. Specifically, for a given 
probability distribution p and tolerance S, we define the set 
of kept spin configurations H(p, S) and the cutoff probability 
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p cut (p, 8) by the following two conditions (see also Fig. 2): 


n(p, 8) = {S | p( S) > ^(p, 8)} , (6a) 

^ p(S) = l-8. (6b) 

SG H(p,S) 

We introduce the short-hand notations Pj/f = 'H(p i /f,8). 
The corresponding partition functions are given by Z'^j = 
(1 — 8)Zi/f. With a finite tolerance 8 , the average {e~^ w ) s is 
given by 

p -pHi P -PH f 

<■=-'">,= E S -#-■ (7 » 

S GW? 1 SGW 5 1 


The free energy change is not affected by tolerance, /3AF = 
— log (Zf/Z-) = — log (Zf/Zi). We thus obtain 


, _ (7 . Ssg « 5 Pf(&) 

6 h ~E S e u°Pf(Sy 


( 8 ) 


Equation (8) is one of our main results and manifests sev¬ 
eral features to be stressed: (i) As illustrated schematically in 
Fig. 2, (e~ a ) s depends crucially on the overlap of Pf and T~L S j. 
For finite 8, well separated initial and final distributions lead 
to vanishing ( e ~ a ) s . For 8 = 0, on the other hand, 7if = T~L + 
and T-L S f = 7 i, and hence (e _cr ) = 1/2 validating the heuristic 
analysis presented in Fig. 1. (ii) Equation (8) also demon¬ 
strates how the convergence issue arises in quenching process 
of phase transitions. Namely, the dominant contributions to 
the ensemble average of e~ a comes from the spin configura¬ 
tions with larger p/(S) whereas the initial equilibrium is gov¬ 
erned by those with larger p ? ;(S). (iii) Equation (8) describes 
highly non-equilibrium processes merely in terms of equilib¬ 
rium distributions, a remarkably simple way to study (e~ IT ) s . 

The tolerance scheme (6) in terms of the microscopic spin 
configurations S is still difficult to implement in practice. For 
example, the tolerance parameter <5 corresponding to the ac¬ 
tual finite sampling is unknown or very difficult to estimate in 
most cases. For this reason, we introduce another operational 
tolerance scheme in terms of the macroscopic order parameter 
S\ Given P(S), we define the interval of relevant magnetiza¬ 
tion X(P, 8) and the cutoff P cu t{P, 8) by 


1(P,5) = {S | P(S) > P CM (P, 8)} , 

[ dSP(S) = l-S. 
Jl(P,S) 


(9a) 

(9b) 


Note that the relation (8) does not depend on a particular tol¬ 
erance scheme, and for the scheme (9) it reads as 


f x sdSP f (S) 

6 )s J x sdsp f (sy 


( 10 ) 


where X ^ = X(P i /f, 8). Below we will mainly use the tol¬ 
erance scheme (9). 



FIG. 2. Schematic representation of the sets Hj ,, of allowed spin 
configurations and their relations to {e~ a ) s . For a given tolerance <5, 
(e~ a ) s is given by the ratio of the areas in black and blue shade. 



FIG. 3. (e~ a ) s from Monte Carlo simulations of the Ising model on 
a 2D square (a,c) and 3D cubic (b,d) lattice. (a,b) Plots of {e~ rT ) s 
as a function of egL for 8 = 0.1 (empty symbols) and 5 = 0.3 
(filled symbols). L = 50 (circles), L = 100 (squares) and L = 200 
(triangles) in 2D (a) and L = 20 (circles), L = 40 (squares) and 
L = 50 (triangles) in 3D (b). Note that, for a given <5, all the curves 
for different L collapse into a single curve. (c),(d) The contour plot 
of {e~ a ) s as a function of egL and 8 [30, Section I.B], The thick red 
line represents the crossover boundary, 8 = 8,(egL). 


Scaling Behavior — We now examine (e~ a } s in Eq. (10) 
more closely, focusing on its scaling behavior inherited from 
the spontaneous symmetry breaking. 

Before providing detailed scaling analyses below, we first 
summarize in Fig. 3 the behavior of ( e~ a ) s as a function of 
CqL and 8, where v is the critical exponent of the correlation 
length, £ ~ |e|“". In Fig. 3 we have performed Monte Carlo 
simulations [30] of the Ising model on two-dimensional (2D) 
square and three-dimensional (3D) cubic lattices. We have 
calculated the distributions P i /j(S) and then ( e~ a ) s based 
on Eq. (10). Figure 3 demonstrates three remarkable features: 
First, for a given 8, (e _cr ) 5 is a universal function of e^L only 
(v = 1 in 2D and v = 0.6301 in 3D [31]) and does not depend 
separately on e 0 an< 3 L\ see Fig. 3 (a) and (b). The discovery 
of this universality is another one of our main results. Sec¬ 
ond, in the parameter space of Cq L and <5, (e~ a ) s ~ 0 in the 
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limit of (cqL, 6) —t (oo, 1 ) while (e a ) s ~ 1/2 in the oppo¬ 
site limit (cgL, 5) —► (0,0); see Fig. 3 (c) and (d). Third, for 
fixed 6, it is suppressed exponentially, (e~ a ) s ~ e~( £ ° L ^ / 2 , 
for sufficiently large systems (eg L 7> 1) while it recovers 
(e~ a ) 5 ~ 1/2 [32] for small systems (egZ < 1). 

According to Eq. (10), the overlap between the distribu¬ 
tion functions P i /f(S) plays a crucial role in (e~ a ') s . Let us 
investigate this overlap based on scaling analysis. For suffi¬ 
ciently large systems, the distributions are rather sharp and it 
suffices to characterize them by the peaks and their widths. 
The initial distribution Pi(S) at e = — eg has a peak near 

S = Mi = {S) pz of width Ai = y/(S 2 ) Pt -(S) 2 pt . Ac¬ 
cording to the fluctuation-dissipation theorem [29], A, is re¬ 
lated to the equilibrium susceptibility \i by A,; = ^Xi/L d - 
Similarly, the final distribution Pf(S) at e = -Ho has a peak 
near S = Mf = (S) pf = 0 of width A / = Xf/L d . The 
magnetization and susceptibility satisfy the standard scaling 
behaviors: 


Adi(eo,L)~ejj$M(e5L), (11) 

Xi(-e 0 ,L) ~ Xf( e o> L) ~ eo 7 $x(eo£) > ( 12 ) 


where /3 and 7 are the critical exponents, and §m/x( z ) are the 
universal scaling functions. The scaling functions asymptot¬ 
ically approach $m/ x ( z ) = 1 for 2 —► 00 while $m{z) ~ 
z~P/ v and $^( 2 ) ~ z y l v for z —t 0. Here, for simplicity 
we have ignored the irrelevant difference in A t = A/ = A 
above and below the critical point. Then the overlap be¬ 
tween the intervals is characterized by a single parameter, 
R = Mi/ A, the relative separation between the two peaks of 
Pi/f(S). Putting Eqs. (11) and (12) together with the Rush- 
brooke scaling law, a + 2/3 + 7 = 2 [29], one has the relative 
separation 


R 


L d / 2 e'n~ 


)/2 ®mYqL) 


Using the Josephson hyperscaling law, dv = 2 
further reduced to 


(13) 
a [29], it is 


R{t 0 ; L) 


(e v 0 L) d/2 


^M(egL) 


(14) 


It is remarkable that the relative separation R(eo,L) = 
R(e%L) does not depend on eg and L separately but is a uni¬ 
versal function of only the combination eg L = L/£g, where 
Co ~ ' s the correlation length at e = eg. This implies 
that ( e~ a ) s is also a universal function of eg L alone, which 
is indeed confirmed by the numerical results shown in Figs. 3 
(a) and 3 (b). Note that the hyperscaling law breaks down 
either in dimensions higher than the upper critical dimension 
<i» = 4 or in the mean-field approximation. In such cases, 
where a = 0 and v = 1/2, ( e~ a ) s is not necessarily a univer¬ 
sal function of ef] L in general. 

For sufficiently large systems (eg L '3> 1), one expects sharp 
distribution functions. Indeed, in this limit it follows that 


R(e" 0 L) ~ {^L ) d ' 2 00 (15) 


and Pi/f(S) are well separated. On the other hand, when the 
system is small (eg L -C 1) and finite-size effect sets in, the 
larger fluctuations lead to broader distribution functions giv¬ 
ing 

R{t%L) ~ 2 +“)/ 2 ^ = 1 (16) 

according to the hyperscaling law. It means that Pi/j(S) have 
significant overlap with each other for a finite-size system. 

With the universal scaling behaviors of relative separation 
R at hand, let us now investigate (e~ a ) s in the parameter 
space of eg L and 6. For a given tolerance S, the two asymp¬ 
totic behaviors in Eqs. (15) and (16) imply little and signif¬ 
icant overlap between Pi/f(S), respectively, and hence that 
(e~ IT ) s ~ 0 in the limit of eg L 1 while (e~ a ) s ~ 1/2 
in the opposite limit of eg L <C 1; see Eq. (10) and Fig. 2. 
For L fixed, on the other hand, large tolerance (S ~ 1) nat¬ 
urally leads to (e~ a ) s ~ 0 whereas we have seen above 
that ( e~ cr ) s ~ 1/2 with 6 ~ 0. In short, as illustrated in 
Figs. 3(c) and (d), ( e~ a ) 5 ~ 0 for eg L 1 and <5 ~ 1 while 
(e~ a ) s ~ 1/2 for egL < 1 and 6 ~ 0 . 

Evidently, a crossover of ( e~ a ) occurs as a result of com¬ 
bined effects of finite size and tolerance. One can locate 
the crossover boundary 6 = <5*(egL) by identifying 5 * for 
given EqL as the maximum tolerance allowing for signifi¬ 
cant overlap between Z?,j. More specifically, (5* is such 
that the lower end of the interval Zf (i.e., min if ; recall 
that Mi > 0 ) equals to the center (i.e., Mf = 0 ) of X d : 

<5*(eg L) = 2 fY rx dS Pi(S). The resulting crossover bound¬ 
aries are illustrated by the thick red lines in Figs. 3 (c) and 
3(d). 

One can investigate (e~ a ) s more closely for sufficiently 
large systems (eg L 1). In such a limit, the distri¬ 

butions Pi/f(S) are sharp enough to be approximated by 
Gaussian forms. Then we observe (see Section I of [30]) 
that ~ (egL) -d / 2 e - ( e o i )' i / 2 and that ( e~ a ) s ~ (1 — 
<5 ) _1 erfc _ 1 (i5)e _ ^ oI '' ) / 2 . In other words, in practice S S* 
always and (e~ cr } s tends to vanish exponentially in the ther¬ 
modynamic limit. 

Conclusion and Discussions — Taking the Ising model as 
an example, we studied the nonequilibrium process of driving 
across a second-order phase transition focusing on the devia¬ 
tion from the JE as a “probe”. By introducing the tolerance 
parameter S, finite sampling of the initial ensemble was taken 
into account. We have found that for a given 5, the average of 
the exponential of the entropy production (e -cr ) is a universal 
function of eg L = L/l; g. As noted previously [18-28], the 
JE may break down for many practical and intrinsic reasons. 
Its breakdown for the dynamical processes of second-order 
phase transitions is peculiar as the deviation is determined by 
an universal combination of the system size L and the ini¬ 
tial reduced coupling eg, which is inherited from the equilib¬ 
rium scaling behavior of second-order phase transitions. It is 
stressed that such a universal scaling behavior is not limited 
to the sudden quenching but holds in general due to the criti¬ 
cal slowing down (see Section II of [30]). Our findings may 
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provide a unique application of the Jarzynski equality to study 
the dynamical properties of phase transitions. 
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